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CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is related to Application No. , filed 

5 , attorney docket number M-8502 US, entitled "ISOLATION OF I2C 

BUSES IN A MULTIPLE POWER DOMAIN ENVIRONMENT USING 

MUTLIPLEXERS", and Application No. , filed , attorney 

docket number M-8504 US, entitled "ISOLATION OF I2C BUSES IN A 
MULTIPLE POWER DOMAIN ENVIRONMENT USING SWITCHES", which 
10 are commonly owned and incorporated by reference herein in their entirety. 

BACKGROUND 

Field of the Invention 

The present invention relates to storage area networks (SANs) and more 
specifically to the isolation of inter-integrated circuit buses (I2C buses) in a 
1 5 multiple power domain environment. 

Description of Related Art 

In a SAN environment, storage devices such as digital linear tapes (DLLs) 
and redundant array of independent disks (RAID arrays) are connected to many 
kinds of servers via a high-speed interconnection such as Fibre Channel. Standard 
20 for Fibre Channel was developed by the American National Standards Institute 

(ANSI) in the early 1990s specifically as a means to transfer large amounts of data 
very fast. The Fibre Channel standard can be used for copper cabling or fiber-optic 
cable at distances of up to 10 kilometers. 

In a typical situation, SANs based on the Fibre Channel standard may be 
25 initially implemented as a group of server systems and storage devices connected 
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by Fibre Channel adapters to a network. As the SAN grows, hubs and switches 
can be incorporated. The Fibre Channel standard supports several configurations 
including point-to-point and switched topologies, hi a SAN environment, the Fibre 
Channel Arbitrated Loop (FC-AL) is used most often to create this high-speed 
5 storage network due to its inherent ability to deliver any-to-any connectivity 
among storage devices and servers. A FC-AL configuration consists of several 
components including servers, storage devices, and a Fibre Channel switch or hub. 

The FC-AL provides not only a high-speed interconnection among storage 
devices but also strong reliabihty. In fact, several devices can be removed from 
10 the loop without any interruption to the data flow. Also, packets sent over a FC- 
AL are error-checked and packets can be re-transmitted if any are lost or corrupted. 
More information regarding SANs and Fibre Channel is provided in an article 
entitled "Storage Area Networks" from NetworkMagazine.com, the entirety of 
which is incorporated herein. 

15 RAID arrays and JBODs are housed in disk enclosures. Devices within 

disk enclosures (e.g., repeaters, enclosure controllers, backplane controllers, 
memory devices, temperature sensors, port bypass circuits, disk drives, and fans) 
run off power supplies. From time to time, such power supplies may fail, thus 
halting the operation of the other devices within the disk enclosures. What is 

20 needed is a disk enclosure with a power scheme with great redundancy. 

SUMMARY 

A disk enclosure includes (1) a first group of one or more power sources 
implementing a first power domain, (2) a first plurality of elements powered by the 
first group of power sources, (3) a second group of one or more power sources 
25 implementing a second power domain, and (4) a second plurality of elements 

powered by the second group of power sources. The disk enclosure also includes a 
first voltage circuit and a second voltage circuit each coupled to the first group of 
power sources and the second group of power sources. The first voltage circuit 
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powers a third plurality of element while the second voltage circuit powers a fourth 
plurality of elements. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of the layout of a disk enclosure, according to an 
5 embodiment of the present invention. 

FIGS. 2 A and 2B are block diagrams of Fibre-Channel Arbitrated Loops 
(FC-ALs) within the disk enclosure of FIG. 1, according to embodiments of the 
present invention. 

FIGS. 3 A and 3B are block diagrams of error detect units in the FC-ALs in 
10 FIGS. 2A and 2B, according to embodiments of the present invention. 

FIGS. 3C and 3D are block diagrams of error detect units separate from 
repeaters and port bypass circuits, according to embodiments of the present 
invention. 

FIG. 4 (comprising of FIGS. 4A and 4B) is a block diagram of a FC-AL 
15 board, a midplane board, backup batteries, power supplies, and disk sled boards of 
the disk enclosure of FIG. 1, according to an embodiment in the present invention. 

FIG. 5 is a schematic diagram, in partial block form, of a voltage circuit 
used to power some devices of the FC-AL board and the midplane board of FIG. 4, 
according to an embodiment in the present invention. 

20 FIG. 6 is a block diagram of a multiplexer of the midplane board of FIG. 4, 

according to an embodiments of the present invention. 

FIG. 7 (comprising of FIGS. 7A, 7B, and 7C) is a block diagram of a FC- 
AL board, a midplane board, backup batteries, power supplies, and disk sled 
boards of the disk enclosure of FIG. 1, according to an embodiment in the present 
25 invention. 
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FIGS. 8, 9, and 10 are block diagrams of switches of the FC-AL board of 
FIG. 7, according to embodiments of the present invention. 

Use of the same reference symbols in different drawings indicates similar 
or identical items. 

5 DETAILED DESCRIPTION 

FIG. 1 is a block diagram illustrating the layout of a disk enclosure 102, 
according to an embodiments of the present invention. As depicted, enclosure 102 
includes eight disk sled boards 103 (only one of which is provided with a reference 
numeral for clarity). These disk sled boards 103 are separately labeled as DSBl to 

10 DSB8. Each disk sled board 103 includes four disk drives 105 (only one of which 
is provided with a reference numeral for clarity). These disk drives are separately 
labeled as DD1-DD32. DDI to DD4 are on DSBl, DD5 to DD8 are on DSB2, . . ., 
and DD29 to DD32 are on DSB8. Each disk sled board includes other devices 
including backplane controllers, port bypass circuits, temperature sensors, and 

1 5 memory devices (shown and described later in reference to FIG. 4). It should be 
understood, of coijrse, that the number of disk sled boards 103 and disk drives 105 
can be varied. 

A number of power supplies 107 (separately labeled as power supply AO, 
power supply Al, power supply BO and power supply Bl) provide power for disk 

20 sled boards 103. In one embodiment, power supplies AO and Al may be 

conventionally current-shared to provide n+1 redundancy; power supplier BO and 
Bl may be conventionally current-shared to provide n+1 redundancy. Power 
supplies AO and Al, along with any corresponding backup batteries (described 
later) may provide or implement a first power domain (power domain A). Power 

25 supplies BO and Bl , along with any corresponding back batteries (described later) 
may provide or implement a second power domain (power domain B). 

In this embodiment, disk enclosure 102 may operate in a split power mode 
where DSBl to DSB4 are powered by power supplies AO and Al (e.g., via one or 
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more power lines from cTirrent- shared power supplies AO and Al, through the 
midplane board 106, and onto DSB 1 to DSB4), and DSB5 to DSB8 are powered 
by power supplies BO and Bl (e.g., via one or more power lines running from 
current-shared power supplies BO and Bl, through the midplane board 106, and 
5 onto DSB5 to DSB8). Accordingly, DSBl to DSB4 are accessible (operational) if 
either power supply AO or Al is present (operational), and DSB5 to DSB8 are 
accessible (operational) if either power supply BO or Bl is present (operational). 
In this embodiment, DSBl to DSB4, may be considered to be located in a power 
domain A because they are powered by current-shared power supplies AO and Al , 

1 0 and DSB5 to DSB 8 may be considered to be located in a power domain B because 
they are powered by current- shared power supplies BO and Bl. In other 
embodiments, disk enclosure 102 may operate in a single power mode where 
DSBl to DSB8 are accessible (operational) if any one of power supplies AO, Al, 
BO, and Bl is present (operational). In these embodiments, a connector couples 

15 the outputs of power domain A (current shared power supplies AO and Al ) and 
power domain B (current shared power supplies BO and Bl) to supply a single 
power to elements of disk enclosure 102. 

Power supplies AO, Al, BO, and Bl each include a separate cooling fan 108 
(only one of which is provided with a reference numeral for clarity). These are 
20 separately labeled as FAO, FAl, FBO, and FBI, respectively. Power supplies AO, 
Al, BO, and Bl are, for example, HF-171s from Acme Electric of Cuba, New 
York. It should be understood, of course, that the number of power supplies can be 
varied to provide greater or lesser redundancy, and each of the power supplies can 
include multiple fans. 

25 A Fibre Channel- Arbifrated Loop (FC-AL) board 104 fimctions to support 

one or more FC-ALs which provide connectivity for disk enclosure 102. FC-AL 
board 104 may include fransceivers, repeaters, enclosure management confrollers, 
and memory devices (shown and described later in reference to FIG. 4). In some 
embodiments (shown and described later in reference to FIGS. 4 and 5), elements 

30 on FC-AL board 1 04 are accessible (operational) if any one of power supplies AO, 
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Al, BO, and Bl is present (operational). In these embodiments, elements on FC- 
AL board 104 are powered by a diode ORed and fused voltage (a shared voltage) 
derived from power domains A and B. 

A midplane board 106 functions to distribute the Fibre Channel loop to the 
5 disk sled boards. Midplane board 1 06 may include multiplexers, port bypass 

circuits, backplane controllers, temperature sensors, memory devices, and 12 C I/O 
expanders (shown and described later in reference to FIG. 4). In some 
embodiments (shown and described later in reference to FIGS. 4 and 5), elements 
on midplane board 106 are accessible (operational) if any one of power supplies 
10 AO, Al, BO, and Bl is present (operational). In these embodiments, elements on 
midplane board 106 are powered by a diode ORed and fused voltage (a shared 
voltage) derived from power domains A and B. 

FIGS. 2 A and 2B are block diagrams illusfrating two FC-ALs 201 
(separately labeled as Loop A and Loop B) through a disk enclosure 102, 

15 according to embodiments of the present invention. Two FC-ALs 201 are 

provided within disk enclosure 102 for redimdancy so that the devices within disk 
enclosure 102 may still communicate in the event that one of the FC-ALs should 
fail. Data may be transmitted in the loops A and B in 8B/10B transmission code. 
As one skilled in the art imderstands, 8B/10B fransmission code is used to provide 

20 DC balance of the transmitted bit stream; to separate transmitted control bytes 
from the data bytes; to simplify bit, byte, and word alignment; and to provide a 
mechanism for detecting transmission and reception errors. 

In one embodiment of Loop A, a first transceiver 202 (labeled transceiver 
AO) receives optical signals from another device in the loop A. Transceiver AO is, 
25 for example, a FTRJ-85 19 Transceiver Module from Finisar Corp. of Sunnyvale, 
California. Transceiver AO converts the optical signals to electrical signals and 
transmits the electrical signals to a first repeater 204 (labeled repeater AO). 
Repeater AO is, for example, a VSC7130 Dual Repeater/Retimer from Vitesse 
Semiconductor Corp. of Camarillo, California. Repeater AO regenerates the 
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electrical signals to meet industrial standard signal quality specifications and 
transmits the regenerated electrical signals to an enclosure controller 206 (labeled 
enclosure controller A). Repeater AO includes an error detect unit 203 (labeled as 
EO -- e.g., a signal detect unit in VSC7130) that conventionally tests for valid Fibre 
Channel data by detecting (1) analog signal amplitude errors, (2) run length errors, 
and (3) absences of synchronization character (e.g., K28.5 ) in regular time 
intervals. An analog signal amplitude error occurs when the electrical signal 
swings are of inadequate amphtude. A run length errors occurs when the data has 
more than five consecutive zeros or ones because valid 8B/10B transmission codes 
do not have more than five consecutive zeros or ones. The absence of the 
synchronization character, such as, for example, a K28.5 character, is an error 
because such a character regularly appears in the Fibre Channel data as a means to 
synchronize the data for decoding. These and other types of errors in Fibre 
Channel are further described in "Fibre Channel Physical and Signaling Interface 
(FC-PH)" (ANSI X3.230-1994) by the American National Standard for 
Information Systems, which is incorporated by reference in its entirety. 

Enclosure controller A is, for example, a SSClOO FC-AL Embedded 
Controller from Vitesse Semiconductor Corp. Enclosure controller A transmits the 
electrical signals to a port bypass circuit 208 (labeled PBC AO). PRC AO is, for 
example, a VSC7128 Hex Port Bypass Circuit/Dual Repeater from Vitesse Corp. 
PBC AO regenerates the electrical signals to meet industrial standard signal quality 
specifications and transmits the regenerated electrical signals to other elements 
(e.g., one or more of DSBl to DSB4). PBC AO also includes an error detect unit 
203 that tests for vahd Fibre Channel data. 

PBC AO is used to bypass any of DSBl to DSB4. For example, it may be 
necessary to bypass one or more disk sled boards that are generating errors in loop 
A in order to hot remove and replace these disk sled boards. Similarly, it may be 
desirable to improve performance (e.g., reduce latency and increase throughput) by 
bypassing one or more disk sled boards from loop A and then use loop B to access 
these disk sled boards. Accordingly, PBC AO selectively transmits the regenerated 
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electrical signals through other port bypass circuits associated with respective disk 
sled boards. As shown, these other port bypass circuits include a port bypass 
circuit 210 (labeled as PBC DS Al). 

Port bypass circuits 210 are, for example, VSC7127 Repeaters/Retimers 
5 and Port Bypass Circuits from Vitesse Corp. Whereas port bypass circuits 208 are 
used to bypass disk sled boards, port bypass circuits 210 are each associated with a 
respective disk sled board and are used to bypass any of the four disk drives 
located on their respective disk sled boards. For example, it may be necessary to 
bypass one or more disk drives that are generating errors in loop A in order to hot 

10 remove and replace these disk drives. Similarly, it may be desirable to improve 
performance (e.g., reduce latency and increase throughput) by bypassing one or 
more disk drives from loop A and use loop B to access these disk drives. 
Accordingly, each of port bypass circuits 210 selectively transmits the electrical 
signals through the four disk drives located on their disk sled boards. For example, 

15 PBC DS Al selectively transmits the electrical signals through disk drives 1 to 4. 
After receiving the electrical signal back from the last disk drive, each of port 
bypass circuits 210 regenerates the electrical signals to meet industrial standard 
signal quality specifications and fransmits the regenerated electrical signals to PBC 
AO. Each of port bypass circuits 210 also includes a respective detect error unit 

20 203 that tests for vaUd Fibre Channel data. After receiving the electrical signals 
back from the last port bypass circuit 210, PBC AO fransmits the electrical signals 
to another port bypass circuit 208 (labeled PBC Al). 

Like PBC AO, PBC Al regenerates the electrical signals to meet industrial 
standard signal quality specifications and fransmits the regenerated electrical 
25 signals to other elements (e.g., one or more of DSB5 to DSB8). PBC Al also 
includes an error detect unit 203 that tests for valid Fibre Channel data. 
Accordingly, PBC Al selectively fransmits the regenerated electrical signals 
through a separate port bypass circuit 210 on each of DSB5 through DSB8. For 
clarity, these other port bypass circuits 210 are not illusfrated in FIG. 2A. 
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M-9949 US 
703059 vl 



Each of the port bypass circuits 210 for DSB5 through DSB8 are used to 
bypass any of the four disk drives located on their respective disk sled boards if 
necessary. Accordingly, each of these port bypass circuits 210 selectively 
transmits the electrical signals through the four disk drives located on their 

5 respective disk sled boards. For example, the port bypass circuit 2 1 0 for DSB5 
selectively transmits the electrical signals through respective disk drives DDI 7 to 
DD20. After receiving the electrical signal back from the last disk drive, each of 
port bypass circuits 210 regenerates the electrical signals to meet industrial 
standard signal quality specifications and transmits the regenerated electrical 

1 0 signals to PBC Al . Each of these port bypass circuits 2 1 0 also includes an error 
detect unit 203 that tests for valid Fibre Channel data. After receiving the 
electrical signals back from the last port bypass circuit 210, PBC Al transmits the 
electrical signals to a repeater 204 (labeled as repeater Al). 

Repeater Al regenerates the electrical signals and transmits the regenerated 
15 electrical signals to a transceiver 202 (labeled as transceiver Al). Repeater Al 
includes an error detect imit 203 that tests for valid Fibre Channel data. 
Transceiver Al converts the electrical signals to optical signals and passes the 
optical signals to another device in the FC-AL. Return signals can travel similarly 
through loop A in the reverse order. As illustrated in FIG. 2 A, each of repeater 
20 Al , PBC Al , PBC AO, and repeater AO includes an error detect unit 203 (labeled 
as El) that tests for valid Fibre Channel data in the return signals. 

As one skilled in the art understands, either repeater AO or Al can act as an 
end of loop A where the electrical signals are routed back through loop A in the 
reverse order. Furthermore, loop A can be spht into two loops where PBC AO acts 
25 as the end of a first loop and PBC Al acts as the end of a second loop. 

FIG. 2B illustrates an embodiment of loop B. Loop B is a duplicate of loop 
A, shown and described in reference to FIG. 2A. Corresponding elements in loops 
B and A have the same reference numeral but for the inclusion of a letter "B" to 
indicate an element of loop B and the mclusion of a letter "A" to indicate an 
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element of loop A. For example, repeaters Bl and Al are corresponding elements. 
In some embodiments, loop A is used to write data to the disk drives on DSBl to 
DSB4 and loop B is used to write data to the disk drives on DSB5 to DSB8. If 
either loop A or B fails, the other loop can be used to access DSBl to DSB8. Of 
course, disk drive access between loops A and B can be varied. 

FIG. 3 A is a block diagram of one embodiment for an error detect unit 203. 
As shown, error detect xmit 203 includes an analog signal amplitude circuit 302 
that detects analog signal atnphtude errors, a run length circuit 304 that detects run 
length errors, and a synchronization character circuit 306 that detects the absence 
of synchronization (e.g., K28.5) characters. Each of circuits 302, 304, and 306 
outputs an active signal to an OR gate 308 if it detects its type of error. OR gate 
308 outputs an active signal to indicate that the current Fibre Channel data is 
invalid (e.g., a real-time error). Error detect unit 203 is, for example, the signal 
detect unit in VSC7127, VSC7128, and VSC7130 Repeaters/Retrievers from 
Vitesse Corp. Of course, error detect unit 203 can alternatively output individual 
active signals from circuits 302, 304, and 306 to specifically identify the type of 
error detected. 

FIG. 3B is a block diagram of another embodiment for an error detect unit 
203. As shown, this embodiment includes an analog signal amplitude circuit 302, 
a run length circuit 304, and a synchronization character circuit 306, similar to 
those described in reference to Fig. 3 A. In addition, this embodiment of error 
detect unit 203 of FIG. 3B includes a transmission character circuit 310 that detects 
transmission character errors and a running disparity circuit 312 that detects 
miming disparity errors. 8B/I0B transmission coding encodes 8 bits of data into a 
10-bit transmission character. A transmission character error occurs when a 
transmission character is invahd because it cannot be decoded to 8 bits of data. A 
running disparity is the disparity between the number of Is and Os transmitted. 
Every 8 bits of data to be transmitted has two corresponding transmission 
characters, one with five or six Is and the other with five or four Is. In 8B/10B 
transmission coding, a sending device keeps track of the running disparity and 



-10- 



M-9949 US 
703059 vl 



selects the transmission character that keeps the running disparity as close to zero 
as possible. A running disparity error occurs when a receiving device detects that 
the running disparity has strayed from zero. 

FIGS. 3C and 3D are block diagrams of embodiments having running 
5 disparity circuit 310 and transmission character circuit 3 12 as discrete integrated 
circuits separate from error detect units 203 in parts of loop A. hi FIG. 3C, serial 
data into repeater 204 is received in parallel by discrete circuits 310 and 312. In 
FIG. 3D, serial data out of PBC 210 is received in parallel by discrete circuits 310, 
312, and PBC 208. As one skilled in the art understands, a link replicator can be 
1 0 used to duplicate and buffer the data from the FC-AL for the discrete circuits 310 
and 312. The link replicator is, for example, a VSC7132 Link RepUcator from 
Vitesse Corp. 

Rxmning disparity circuit 310 and transmission character circuit 312 can be 
implemented in a variety of ways. For example, fransmission character 312 can be 
1 5 implemented with a logic that compares the transmission characters received with 
valid transmission characters stored in a memory device. Alternatively, running 
disparity circuit 310 can be implemented with a logic that keeps tracks of 
difference between the number of Is and Os in the transmission characters. 

Referring again to Fig. 3B, each of circuits 302, 304, 306, 310, and 312 
20 outputs an active signal to OR gate 308 if it detects its respective error. OR gate 
308 outputs an active signal, which is the output signal for error detect unit 203, to 
indicate that the current Fibre Channel data is invahd (e.g., a real-time error). Of 
course, error detect unit 203 can alternatively output individual active signals from 
circuits 302, 304, 306, 310, and 312 to specifically identify the type of error 
25 detected. 

Error detect units 203 on repeaters 204 and port bypass circuits 208 are 
used to isolate an element that is generating transmission errors in loop A or loop 
B. By including circuits 310 and 312 in or along with error detect units 203, 
additional types of errors can be detected. The following examples illustrate how 
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error detect units 203 can be used to isolate an element that is generating 
transmission errors in loop A or loop B. 

One example applies to the link between repeater AO and PBC AO. If error 
detect unit 203 (EO) of repeater AO does not detect an error and error detect unit 

5 203 (EO) of PBC AO detects an error, then enclosure controller A may be 

generating an error because enclosure controller A is the element located between 
error detect units 203 of repeater AO and PBC AO. If enclosure controller A is 
replaced and the error persists, then the internal circuitry of repeater AO or PBC AO 
may be generating the error. Each of repeater AO and PBC AO can be individually 

1 0 replaced to determine which element is causing the error. If the error persists even 
then, then the circuit boards that house and interconnect repeater AO, enclosure 
controller A, and PBC AO may be causing the error. Thus, the circuit boards can 
be individually replaced to determine which board is causing the error. 

Another example applies to the link between PBC AO and PBC DS Al . If 
1 5 error detect unit 203 (EO) of PBC AO does not detect an error and error detect unit 
203 (EO) of PBC DS Al detects an error, then one or more of disk drives DDI to 
DD4 may be generating the error because these disk drives are the elements 
between respective error detect units 203 of PBCs AO and PBCC DS Al . To 
determine which disk DDI to DD4 is causing the error, disk drives 1 to 4 can be 
20 individually placed on the loop to see if the error is detected. If the error persists 
even after all the disk drives are checked, then the internal circuitry of PBC AO or 
PBC DS Al may be generating the error. Each of PBC AO and PBC DS Al can be 
individually replaced to determine which element is causing the error. If the error 
persists even then, then the circuit boards that house and interconnect PBC AO, 
25 PBC DS Al , and respective disk drives (DDI TO DD4) may be causing the error. 
Thus, the circuit boards can be individually replaced to determine which board is 
causing the error. The above examples can be similarly applied to loop B 
elements. 
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FIG. 4 (comprising of FIGS. 4A and 4B) is a block diagram of FC-AL 
board 104, midplane board 106, DSBl to DSB8, power supplies 107 (power 
supplies AO, Al, BO, and Bl) and backup batteries 401 (labeled as BAO, BAl, 
BBC AND BBl), according to embodiments of the present invention. Batteries 
BAO, BAl, BBO, and BBl are located in an enclosure (not shown) external to disk 
enclosure 102 in some embodiments. Batteries BAO, BAl, BBO, and BBl are 
respectively coupled to power suppUes AO, Al, BO, and Bl to provide backup 
power in case of AC power failures. Power supplies 107 may include chargers 
(not shown) used to charge their respective batteries 401. Batteries 401 are, for 
example, RA-17s from ACME Electric. Power supplier AO, Al and batteries BAO, 
BAl cooperate to provide power for power domain a. Power supplier BO, Bl and 
batteries BBO, BBl cooperate to provide power for power domain B. 

In some embodiments, loop A elements on FC-AL board 104 and midplane 
board 106 (described herein) are powered by a first voltage circuit 402 (labeled 
voltage circuit A) located on midplane board 106, and loop B elements on FC-AL 
board 104 and midplane board 106 are powered by a second voltage circuit 
(labeled voltage circuit B) located on midplane board 106. Voltage circuits 402 
(described later in reference to FIG. 5) respectively provide voltages Vshared-A 
and Vshared-B derived from power domains A and B. Duplicate voltage circuits 
402 are provided so that loop A elements and loop B elements are not disabled by 
the failure of a single voltage circuit. 

FIG. 5 is a schematic diagram, in partial block form, of voltage circuit 402 
used to generate Vshared-A, according to an embodiment of the present invention. 
Voltage circuit 402 generates a diode ORed and ftised voltage derived from power 
domains A and B. A voltage A from current shared power supplies AO and Al is 
fed via a frise 502 to a diode 504, and a voltage B from current shared power 
supplies BO and Bl is fed via a ftise 503 to a diode 505. Diodes 504 and 505 are 
coupled to supply voltage Vshared-A to loop A elements on FC-AL board 104 and 
midplane board 106. Thus, voltage Vshared-A will be maintained if either voltage 
A or B is suppUed. Accordingly, loop A elements on FC-AL board 1 04 and 
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midplane board 106 remain accessible (operational) if any one of the power 
supplies AO, Al, BO, and Bl is present (operational). Voltage circuit B is 
implemented in the same or similar fashion to supply voltage Vshared-B to loop B 
elements on FC-AL board 104 and midplane board 106. 

5 Referring again to FIG. 4, FC-AL board 1 04 comprises various loop A 

elements which, as shown, include enclosure controller A, memory 406 (labeled 
FB memory A), transceivers AO and Al, and repeaters AO and Al . Enclosure 
controller A monitors and/or controls other loop A elements. FB memory A, 
which is coupled via an I2C bus 404 to a enclosure controller A, stores instructions 

1 0 for enclosure controller A and FC-AL board specific information. FC-AL board 
specific information includes bytes of data written to memory A, byte size of FB 
memory A, FC-AL board part numbers, revision number, vendor identification, 
assembly date, serial number, and checksum of the data written to FB memory A. 
FB memory A may comprise, for example, an AT24C04 Serial EEPROM from 

15 Atmel Corporation of San Jose, California. Enclosure controller B is also coupled 
via I2C bus 404 to enclosure controller A. Thus, enclosure controller A can 
control and/or monitor loop B elements via enclosure controller B, and vice versa. 

Enclosure controller A is coupled via an I2C bus 408 to control and/or 
monitor repeaters AO and Al. For example, enclosure controller A (1) monitors 
20 errors detected by repeaters AO and A 1 , (2) monitors the performance of repeaters 
AO and Al, and (3) controls whether repeaters AO and Al act as the ends of loop A 
so that the electrical signals are looped back through loop A in the reverse order. 

Midplane board 106 includes various loop A elements, such as a backplane 
controller 410 (labeled MB I2C backplane controller A), a memory 412 (labeled as 
25 MB memory A), a temperature sensor 414 (labeled as MB temp, sensor A), an I2C 
input/output expander 416 (labeled as MB I2C I/O expander A), a l-of-8 
multiplexer 418 (labeled as Mux A), and PBCs AO and Al. Enclosure controller A 
is coupled via I2C bus 408 to control and/or monitor backplane controller A, MB 
memory A, MB temp sensor A, and I2C I/O expander A. Enclosure controller A 
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uses backplane controller A to control and/or monitor (1) PBCs AO and Al, (2) 
fans FAO, FAl, FBO, and FBI, and (3) power supplies AO, Al, BO, and Bl. 
Backplane controller A is, for example, a SSC050 12C Backplane Controller from 
Vitesse. 

5 Backplane controller A controls and/or monitors PBCs AO and Al via 

respective I/O lines 422 and 424. For example, backplane controller A (1) detects 
the presence of disk sled boards, (2) enables the bypass of selected disk sled 
boards, (3) detects real-time errors identified by error detect unit of PBCs AO and 
Al, and (4) enables the split of loop A by using PBC AO as the end of a first loop 

10 and PBC Al as the end of a second loop. 

In one embodiment, each of PBCs AO and Al includes an edge-detecting 
latch that is set when a real-time error is detected. This latch remains set until it is 
cleared by backplane controller A. In these embodiments, backplane controller A 
also detects and clears latched errors identified by PBCs AO and Al . Backplane 

1 5 controller A can use the detection of real-time and latched errors to determine if a 
part of loop A (e.g., a link) before PBC AO or A 1 is down or has intermittent real- 
time errors. For example, a link in loop A is down if backplane controller A (1) 
detects a real-time error and a latched error, (2) clears the latched error, and (3) 
detects another real-time error but not another latched error. A link in loop A has 

20 intermittent errors if backplane controller A (1) detects a latched error, (2) clears 
the latched error, and (3) detects another latched error. 

MB I2C backplane controller A controls and/or monitors fans FAO, FAl, 
FBO, and FBI via FO lines 426. For example, backplane controller A detects the 
failure of fans FAO, FAl, FBO, and FBI. Backplane controller A controls and/or 
25 monitors power supplies AO, Al , BO, and B 1 via FO lines 428. For example, 
backplane controller 410 (1) enables the power supplies and (2) detects (a) the 
presence of power supplies, (b) the failure of the power supplies, (c) the failure of 
AC supply to the power supplies, and (d) the overload of the chargers that charge 
the backup batteries (e.g., excessive charging time due to the number of backup 
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batteries being charged). For clarity, fans FAO, FAl, FBO, and FBI, power 
supplies AO, Al, BO, and Bl, and their I/O lines are not shown individually. 

Enclosure controller A accesses MB memory A to read midplane board 
specific information including bytes of data written to MB memory A, byte size of 

5 MB memory A, midplane board part numbers, revision number, vendor 

identification, assembly date, serial number, and checksum of the data written to 
MB memory A. MB memory A is, for example, an AT24C08 Serial EEPROM 
from Atmel. Enclosure controller A accesses MB temp, sensor A to monitor the 
temperature of midplane board 106. MB temp, sensor A is, for example, a LM75 

1 0 Digital Temperature Sensor and Thermal Watchdog from National Semiconductor 
Corporation of Santa Clara, Cahfomia. I2C I/O expander A is coupled via I/O 
lines A to backup batteries BAO, BAl, BAO, and BBl (through respective power 
suppUes AO, Al, BO, and Bl). Enclosure controller A accesses I2C I/O expander 
A to determine the number of backup batteries present and to test the backup 

15 batteries for sufficient charge. I2C I/O expander A is, for example, a PCF8574 
from Philips Semiconductor of Netheriands. For clarity, backup batteries BAO, 
BAl, BAO, and BBl, and their I/O lines are not shown individually. 

Enclosure confroUer A also uses MB I2C backplane confroUer A to control 
Mux A on midplane board 106 to selectively couple an I2C bus to loop A elements 

20 on DSBl to DSB8 (described later in reference to FIG. 6). MB I2C backplane 

controller A controls Mux A via I/O lines 430. Mux A selectively couples I2C bus 
420 to one of DSBl to DSB8. Specifically, Mux A selectively couples I2C bus 
420 to one of I2C buses 434. I2C buses 434 are coupled to loop A elements on 
respective DSBl to DSB8. Specifically, each I2C bus 434 is coupled to a number 

25 of loop A elements of a respective disk sled board, including, for example, 

temperature sensor 436 (labeled, e.g., DSB temp, sensor Al, A8), I2C backplane 
controller 438 (labeled, e.g., DSB backplane controller Al, A8), and memory 440 
(labeled, e.g., DSB memory Al, AS). For clarity, only a portion of I2C buses 434 
and respective disk sled boards are illustrated in FIG. 4. 
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In one embodiment, temperature sensors 436 are of the same type as the 
previously described temperature sensor 414, 12C backplane controllers 438 are of 
the same type as the previously described I2C backplane controller 410, and 
memories 440 are of the same type as the previously described memory 412 I2C 

5 backplane controllers 438 are coupled to respective port bypass circuits 210 (also 
loop A elements) via respective I/O lines 442. I2C backplane controllers 438 
control and/or monitor port bypass circuits 210. For example, backplane 
controllers 438 (1) enable the bypass of selected disk drives, (2) detect the bypass 
ready status of the disk drives, (3) detect the presence of the disk drives, (4) detect 

10 errors reported by the disk drives, (5) detect errors and latched errors identified by 
port bypass circuits 210, (6) clear latched errors detected by port bypass circuits 
210, (7) select the operation mode of port bypass circuits 210 (e.g., repeater or 
retimer mode), and (8) detect the power mode of DSBl to DSB8 (e.g., split or 
single power mode). To detect a single power mode, backplane controllers 438 

15 can have an I/O line coupled to the connector that couples the outputs of power 
domains A and B to supply a single power to disk enclosure 102. Port bypass 
circuits 210 are coupled to their respective disk drives (e.g., disk drives DDI to 
DD4 for PBC DS Al and disk drives DD29 to DD32 for PBC DS A8) via 
respective I/O hues 444. 

20 FIG. 6 illustrates an embodiment for mux 418. As shown, mux 418 

includes an inverter 602 and l-of-4 muxes 604 and 605. Inverter 602 has an input 
terminal 606 coupled to receive a signal I2C_A_SEL2 firom one of I/O lines 430 of 
MB 12C backplane controller A, and an output terminal 608 coupled to an output 
enable terminal lOE and a chip enable terminal 2CE of mux 605. Mux 604 has an 

25 output enable terminal lOE and a chip enable terminal 2CE coupled to receive 
signal I2C_A_SEL2 from one of I/O Unes 430. In one embodiment, muxes 604 
and 605 are enabled by active low signals on terminals lOE and 2CE. Thus, mux 
604 is enabled by a logic low signal I2C_A_SEL2 and mux 605 is enabled by a 
logic high signal I2C_A_SEL2. 
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Each of muxes 604 and 605 has data input terminals 1 A and 2 A 
respectively coupled to receive I2C data signal EMC_A_SDA2 and I2C clock 
signal EMC_A_SCL2 from I2C bus 420 of enclosure controller A. Once enabled, 
the selected one of muxes 604 and 605 outputs I2C data signal EMC_A_SDA2 and 

5 I2C clock signal EMC_A_SCL2 to a pair of output lines (e.g., IBl and 2B1) 

selected by address signals I2C_A_SEL0 and I2C_A_SEL1 received on respective 
address terminals SO and SI from two of I/O lines 430 of MB I2C backplane 
confroUer A. Each pair of output Hnes is coupled to one of I2C buses 434 for 
respective disk sled boards. For example, output lines IBl and 2B1 of mux 604 

10 are coupled to I2C bus 434 for DSBl, and output lines 1B4 and 2B4 of mux 605 
are coupled to I2C bus 434 for DSB8. Thus, a three bit address signal from I/O 
lines 430 of MB I2C backplane controller A (I2C_A_SEL0, 12C_A_SEL1, and 
12C_A_SEL2) is used to select one of DSBl to DSB8 to receive the I2C clock and 
data signals from I2C bus 420 of enclosure controller A. Table 1 below illusfrates 

15 an exemplary address scheme for selecting one of DSBl to DSB8. Inverter 602 is, 
for example, a SN74AHC1G04 Single Inverter Gate from Texas Instrument of 
Dallas, Texas, and muxes 604 and 605 are, for example, SN74CBT3253 Dual 1-of- 
4 FET Multiplexers/Demultiplexers from Texas Instrument. 



TABLE 1 



I2C_A_SEL0 


I2C_A_SEL1 


I2C_A_SEL2 


Selected DSB 


1 


1 


1 


DSB8 


1 


1 


0 


DSB7 


1 


0 


1 


DSB6 


1 


0 


0 


DSB5 


0 


1 


1 


DSB4 
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0 


I 


0 


DSB3 


0 


0 


1 


DSB2 


0 


0 


0 


DSBl 



As can be seen from FIG. 4, loop A elements are duplicated as loop B 
elements on FC-AL board 104, midplane board 106, and DSBl to DSB8 in some 
embodiments. Corresponding loop B elements and loop A elements have the same 

5 reference niimeral but for the inclusion of a letter "B" to indicate a loop B element 
and the inclusion of a letter "A" to indicate a loop A element. As described above, 
loop A elements on FC-AL board 104 and midplane board 106 are powered by 
Vshared-A, and loop B elements on FC-AL board 104 and midplane board 106 are 
powered by Vshared-B. Furthermore, DSBl to DSB4 are powered by voltage A 

1 0 (e.g., located in power domain A) and DSB5 to DSB8 are powered by voltage B 
(e.g., located in power domain B) in a split power mode, or DSBl to DSB8 are 
powered by a single power derived from power domains A and B in a single power 
mode. 

As described above, I2C bus 420 is selectively coupled to one of I2C buses 
15 434 via Mux A. Thus, I2C buses 434 are not coupled to each other. When one or 
more of I2C buses 434 are grounded because of a failure of a loop A element, the 
other I2C buses are not pulled to ground and can still be used by enclosure 
controller A to access other loop A elements. For example, I2C buses 434 for 
DSB2 to DSB8 are not pulled to ground when I2C bus 434 for DSBl is grounded 
20 by a failure of respective DSB temp, sensor 436. Enclosure controller A can cause 
Mux A to couple I2C bus 420 to any of the other I2C buses 434 to access loop A 
elements on DSB2 to DSB8. Similarly, I2C buses 434 for DSBl to DSB4 are not 
pulled to ground when I2C buses 434 for DSB5 to DSB8 are grounded by a failure 
of power supphes BO and Bl (power domain B that powers DSB5 to DSB8 in spHt 
25 power mode). Enclosure controller A can cause Mux A to couple I2C bus 420 to 
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any of the respective I2C buses 434 for to access loop A elements on DSBl to 
DSB4. 

Furthermore, I2C buses 434 for power domain A are not coupled to I2C 
buses 434. I2C buses 434 are isolated from the grounding of I2C buses for power 
domain B, and vice versa. Thus, either set of I2C buses 434 can be used to access 
their respective elements on the disk sled boards when the other set of I2C buses 
434 fails. For example, I2C buses 434for power domain B are not pulled to ground 
when I2C buses 434 for power domain A are grounded because of a failure of 
power suppHes and/or loop A elements. Enclosure controller B can cause Mux B 
to couple an associated I2C bus 420 to any of I2C buses 434 to access loop B 
elements on DSBl to DSB8. 

FIG. 7 (comprising of FIGS. 7A, 7B, and 7C) illustrates another 
embodiment of disk enclosure 102 . FIG. 7 is a block diagram of midplane board 
106, a FC-AL board 104, and a plurality of disk sled boards 103 (separately 
labeled DSBl to DSB8), according to an embodiment of the present invention. In 
this embodiment, enclosure controller A accesses FB memory A via I2C bus 905. 
Enclosure controller A controls and/or monitors repeaters AO and A 1 via an I2C 
bus 920. I2C bus 920 is also coupled to I2C elements on DSBl to DSB4. 
Specifically, I2C bus 920 is coupled to (1) DSB temp, sensor Al, DSB I2C 
backplane controller Al, and DSB memory Al on DSBl, (2) DSB temp, sensor 
A2, DSB I2C backplane controller A2, and DSB memory A2 on DSB2, (3) DSB 
temp, sensor A3, DSB I2C backplane controller A3, and DSB memory A3 on 
DSB3, and (4) DSB temp, sensor A4, DSB I2C backplane controller A4, and DSB 
memory A4 on DSB4. DSB backplane controllers Al to A4 are respectively 
coupled to PBCs DS Al to DS A4 via respective I/O lines 942. PBCs DS Al to 
DS A4 are respectively coupled to disk drives DDI to DD3, DD4 to DD8, DD9 to 
DD12, and DD13 to DD16 via respective I/O lines 944. Enclosure controller A 
controls and/or monitors PBCs DS Al to DS A4 (and thus disk drives DDI to 
DDI 6) via DSB I2C backplane controllers Al to A4. 
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I2C bus 920-A is further coupled via a switch 952 to an I2C bus 922 of 
enclosure controller B so enclosure controller B can also access I2C elements on 
DSBl to DSB4. As FIG. 7 illustrates, DSB I2C backplane controllers Al to A4 
are also respectively coupled to PBCs DS Bl to DS B4 via respective I/O hnes 
943. PBCs DS Bl to DS B4 are respectively coupled to disk drives DDI to DD3, 
DD4 to DD8, DD9 to DDI 2, and DDI 3 to DDI 6 via respective I/O lines 945. 
Enclosure controller B controls and/or monitors PBCs DS Bl to DS B4 (and thus 
disk drives DDI to DDI 6) via DSB I2C backplane controllers Al to A4. For 
clarity, only DSBl and DSB4 are illustrated in FIG. 7. 

FIG. 8 illustrates a switch 952 in one embodiment. Switch 952 has (1) data 
input/output terminals 1002 coupled to I2C bus 920, (2) data input/output terminals 
1004 coupled to I2C bus 922, and (3) an enable terminal 1006 coupled to voltage 
Vshared-B supplied by a voltage circuit 1302 shown in Fig. 7 and labeled as 
voltage circuit B on midplane board 106. This voltage circuit 1302 can be the 
same as the previously described voltage circuits 402. The voltage circuits 1302 
supplies Vshared-B to loop B elements on FC-AL board 104 (e.g., enclosure 
controller B) and midplane board 106. 

Switch 952 couples I2C bus 920 with I2C bus 922 when Vshared-B is high. 
Switch 952 de-couples I2C bus 920 from I2C bus 922 when Vshared-B is low 
(e.g., falls below a predetermined threshold or becomes grounded). Thus, I2C bus 
920 is not pulled to ground when I2C bus 922 is grounded by a failure of voltage 
circuit B. Accordingly, enclosure controller A can continue to monitor I2C 
elements on DSBl to DSB4 when I2C bus 922 is grounded by a failure of vohage 
circuit 1302-B. Switch 952 is powered by Vshared-A supplied by a voltage circuit 
1302 shown in Fig. 7 and labeled as voltage circuit A. Voltage circuit 1302 can be 
the same as the previously described voltage circuits 402. Voltage circuit A 
supplies voltage Vshared-A to loop A elements on FC-AL board 104 (e.g., 
enclosure controller A) and midplane board 106. Switch 952 is, for example, a 
SN74HC4066 Quadruple Bilateral Analog Switch from Texas Instrument. 
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Referring back to FIG. 7, enclosure controller B controls and/or monitors 
repeaters BO and Bl via an I2C bus 921. I2C bus 921 is also further coupled to 
I2C elements on DSB5 to DSB8. Specifically, I2C bus 921 is coupled to (1) DSB 
temp, sensor B5, DSB I2C backplane controller B5, and DSB memory B5 on 
DSB5, (2) DSB temp, sensor B6, DSB I2C backplane controller B6, and DSB 
memory B6 on DSB6, (3) DSB temp, sensor B7, DSB I2C backplane controller 
B7, and DSB memory B7 on DSB7, and (4) DSB temp, sensor B8, DSB I2C 
backplane controller B8, and DSB memory BE on DSB8. DSB I2C backplane 
controllers B5 to B8 are respectively coupled to PBCs DS B5 to DS B8 via 
respective I/O lines 943. PBCs DS B5 to DS B8 are respectively coupled to disk 
drives DD17 to DD20, DD21 to DD24, DD25 to DD28, and DD29 to DD32 via 
respective I/O lines 945. Enclosure controller B controls and/or monitors PBCs 
DS B5 to DS B4 (and thus disk drives DDI 7 to DD32) via DSB I2C backplane 
controllers B5 to B8. 

I2C bus 921 is further coupled via a switch 953 to an I2C bus 924, which is 
connected to enclosure controller A. Thus, enclosure controller A can also access 
I2C elements on DSB5 to DSB8. As FIG. 7 illustrates, DSB I2C backplane 
controllers B 5 to B 8 are also respectively coupled to PBCs DS A5 to DS A8 via 
respective I/O lines 942. PBCs DS A5 to DS A8 are respectively coupled to disk 
drives DDI 7 to DD20, DD21 to DD24, DD25 to DD28, and DD29 to DD32 via 
I/O lines 944. Enclosure controller A controls and/or monitors PBCs DS AS to DS 
A8 (and thus disk drives DDI 7 to DD32) via DSB I2C backplane controllers B5 to 
B8. For clarity, only DSB5 and DSB8 are illustrated in Fig. 7. 

FIG. 9 illustrates switch 953 in one embodiment. Switch 953 has (1) data 
input/output terminals 1 102 coupled to I2C bus 921, (2) data input/output terminals 
1 104 coupled to I2C bus 924, and (3) an enable terminal 1 106 coupled to voltage 
Vshared-A supplied by voltage circuit A. Switch 953 couples I2C bus 921 with 
I2C bus 924 when Vshared-A is high. Switch 953 de-couples I2C bus 921 firom 
I2C bus 924 when Vshared-A is low (e.g., falls below a predetermined threshold or 
becomes grounded). Thus, I2C bus 921 is not pulled to ground when I2C bus 924 
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is grounded by a failure of voltage circuit 1302. Accordingly, enclosure controller 
B can continue to monitor I2C devices on DSB5 to DSB8 when I2C bus 924 is 
grounded by a failure of voltage circuit A. Switch 951 is powered by Vshared-B 
supplied by power voltage circuit B. Switch 953 is of the same type as switch 952- 
5 A. 

Referring back to FIG. 7, enclosure controller A is coupled via an I2C bus 
926 to a switch 950 (described later). I2C bus 926 is coupled via switch 950 to an 
I2C bus 908. Similarly, enclosure controller B is coupled via an I2C bus 928 to a 
switch 951 (described later). I2C bus 928 is coupled via switch 951 to I2C bus 
10 908. I2C bus 908 is coupled to I2C elements on midplane board 1 06. 

FIG. 10 illustrates switches 950 and 951 in some embodiments. Switch 
950 has (1) data input/output terminals 1202 coupled to I2C bus 926, (2) data 
input/output terminals 1204 coupled to I2C bus 908, and (3) an enable terminal 
1206 coupled to voltage Vshared-A supplied by voltage circuit A. Switch 950 

1 5 couples I2C bus 926 with I2C bus 908 when Vshared-A is high. Switch 950 de- 
couples I2C bus 926 from I2C bus 908 when Vshared-A is low (e.g., falls below a 
predetermined threshold or becomes grounded). Thus, I2C bus 908 is not pulled to 
the ground when I2C bus 926 is grounded by a failure of voltage circuit A. 
Accordingly, enclosure controller B can contmue to monitor I2C devices on 

20 midplane 906 when I2C bus 924 is grounded by a failure of voltage circuit A. 
Switch 950 is powered by voltage Vshared-B supplied by voltage circuit B. 
Switch 950 is of the same type as switch 952. 

Switch 951 has (1) data input/output terminals 1203 coupled to I2C bus 
928, (2) data input/output terminals 1205 coupled to I2C bus 908, and (3) an 
25 enable terminal 1207 coupled to voltage Vshared-B supplied by voltage circuit B. 
Switch 951 couples I2C bus 928 with I2C bus 908 when Vshared-B is high. 
Switch 951 de-couples I2C bus 958 from I2C bus 908 when Vshared-B is low 
(e.g., grounded). Thus, I2C bus 908 is not pulled to the ground when I2C bus 928 
is grounded by a failure of voltage circuit B. Accordingly, enclosure controller A 
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can continue to monitor I2C devices on midplane 906 when I2C bus 928 is 
grounded by a failure of voltage circuit B. Switch 951 is powered by voltage 
Vshared-A suppHed by voltage circuit A. Switch 951 is of the same type as switch 
952. 

5 Referring again to FIG. 7, midplane board 106 includes an MB I2C 

backplane controller 410, an MB memory 412, an MB temperature sensor 414, an 
I2C I/O expander 416, PBCs A and B, and the previously described voltage 
circuits 1302 (voltage circuits A and B). I2C bus 908 from FC-AL board 104 is 
coupled to MB I2C backplane controller 410, MB memory 412, MB temperature 
1 0 sensor 414, and I2C I/O expander 41 6. MB I2C backplane controller 410, MB 
memory 412, MB temperature sensor 414, and MB I2C I/O expander 416 are 
powered by either voltage circuit A or B. 

MB I2C backplane controller 410 controls and/or monitors (1) PBC A via 
I/O lines 1322, and (2) PBC B via I/O lines 1324. PBC A is used to bypass any of 

1 5 PBCs DS Al to DS A4 while PBC B is used to bypass any of PBCs DS B5 to DS 
B8. I2C I/O expander 416 is coupled to (1) fans FAO, FAl, FBO, and FBI via I/O 
lines 1026, (2) power supphes AO, Al, BO, and Bl via FO lines 1328, and (3) 
backup batteries BAO, BAl, BBO, and BBl via UO lines 1332 (through respective 
power supplies AO, Al, BO, and Bl). Enclosure controllers A and B use I/O 

20 expander 41 6 to control and/or monitor the fans, the power supphes, and the 

backup batteries. In some embodiments, the functions of loop A elements and loop 
B elements illustrated in FIG. 7 are the same as the functions of the loop A 
elements and loop B elements illustrated in FIG. 4. 

Although the invention has been described with reference to particular 
25 embodiments, the description is only an example of the invention's application and 
should not be taken as a limitation. Various other adaptations and combinations of 
features of the embodiments disclosed are within the scope of the invention as 
defined by the following claims. 
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